How to improve the outcome of performance evaluations in terms of percentiles for citation frequencies of my papers
نویسنده
چکیده
Using empirical data I demonstrate that the result of performance evaluations by percentiles can be drastically influenced by the proper choice of the journal in which a manuscript is published. 1. Introduction In order to evaluate the impact of publications in terms of citation counts recently percentile-based bibliometric indicators have gained more and more attention (Bornmann, Leydesdorff, & Mutz, 2013). They are based on the idea of determining the position of a publication within a citation distribution of its field and its publication year (Leydesdorff & Bornmann, 2011). This position is usually expressed in terms of a quantile of the citation distribution. Commonly, percentiles are used for that purpose. These can then be utilized to attribute the evaluated papers to certain percentile rank classes. A simple and frequently used indicator is the proportion of publications which belong to the top 10% most frequently cited publications (Tijssen, Visser & Van Leeuwen, 2002, Bornmann, De Moya Anegón & Leydesdorff, 2012) in a given field for a given publication year. This would mean two percentile rank classes, namely the top 10% and the bottom 90%. Of course, different thresholds might be useful for different evaluation purposes (Lewison, Thornicroft, Szmukler & Tansella, 2007). Also more complicated indicators combining several thresholds and several percentile rank classes have been proposed (Leydesdorff, Bornmann, Mutz & Opthof 2011, Leydesdorff & Bornmann, 2012). The much appraised advantage of percentile-based indicators is that they allow a straightforward comparison of the evaluation results for publications in different fields and a suitable comparison of old and new publications, because the citation frequency of each publication of an author (or an institute, or a country, …) is compared with the complete citation distribution of publications in the corresponding field and publication year. It is well known that these reference sets can differ strongly between different fields. Therefore it appears fair to measure the impact of a publication in this way, i.e. in relation to its field. By the same token this means, however, that one can influence the position of one's publication in its citation distribution by choosing the journal and thereby the field and thus the reference set in a more or less clever way. It is the purpose of the present paper to demonstrate this effect for an empirical example, namely five of my own publications for which a choice of a different journal would have drastically improved the position of …
منابع مشابه
How to analyse percentile impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes and top-cited papers
According to current research in bibliometrics, percentiles (or percentile rank classes) are the most suitable method for normalising the citation counts of individual publications in terms of the subject area, the document type and the publication year. Up to now, bibliometric research has concerned itself primarily with the calculation of percentiles. This study suggests how percentiles can b...
متن کاملThe role of papers in academic promotion
Writing research papers and books as well as publishing in scientific journals are very important in universities’ scientific promotion. They have a veto-like role in promotion procedure. Reaching high level in academic procedure is valuable, provided that scientific activities reach the highest points and, above all, can be used in solving each country’s internal problems. Here, by papers, I ...
متن کاملبررسی تأثیر استنادی مقالههای مجلات علمی- پژوهشی فارسی زبان ایران
Purpose: We have studied in the present research the citation impact of the papers published in Iranian Farsi scientific-research journals in the three fields of medical sciences, agricultural sciences, and human sciences, which have been indexed in SID citation database. Methodology: This study used citation analysis. The population under study included all papers with two or more citations i...
متن کاملHow to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes, and top-cited papers
According to current research in bibliometrics, percentiles (or percentile rank classes) are the most suitable method for normalizing the citation counts of individual publications in terms of the subject area, the document type, and the publication year. Up to now, bibliometric research has concerned itself primarily with the calculation of percentiles. This study suggests how percentiles (and...
متن کاملTherapeutic exercises can improve lower extremity functional indexes of people with dynamic knee valgus: A systematic review and meta-analysis
Purpose: One of the most significant contributors to lower extremity degeneration alterations and its effects on balance and sports performance is dynamic knee valgus faulty movement pattern. Different exercise interventions have been conducted to improve dynamic knee valgus. The extensive research and meta-objective analysis aimed to assess how exercise interventions affected people with dynam...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- J. Informetrics
دوره 8 شماره
صفحات -
تاریخ انتشار 2014